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ATTACHMENT A 

Clean Replacement/New Claims (entire set of pending claims) 
Following herewith is a clean copy of the entire set of pending claims. 

1 . A method of regulating negotiation between two or more negotiating parties 
which communicate using an electronic communication network, the method 
employing a set of negotiating propositions characterizing a negotiating environment, 
the propositions including one or more hypotheses, and the method having the steps 
of: 

for each of said one or more hypotheses deriving a respective numerical 
confidence value, the or each confidence value representing confidence in the truth 
of the respective hypothesis; and 

regulating the negotiation between said negotiating parties using said 
electronic communication network, based on said one or more confidence values. 

2. A method according to claim 1 in which the negotiating parties negotiate 
according to a set of rules, and said regulation includes varying the set of rules 
based on said one or more confidence values. 

3. A method according to claim 2 in which the set of rules are varied upon said 
one or more confidence values indicating a high likelihood of the negotiation 
reaching a predetermined disadvantageous condition. 

4. A method of negotiation with one or more other negotiating parties by 
communication using an electronic communication network, the method employing a 
set of negotiating propositions characterizing a negotiating environment, the 
propositions including one or more hypotheses, and the method having the steps of: 

for each of said one or more hypotheses deriving a respective numerical 
confidence value, the or each confidence value representing confidence in the truth 
of the respective hypothesis; and 

negotiating based on said one or more confidence values. 
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5. A method according to claim 4 in which said step of negotiating based on said 
one or more confidence values comprises using said one or more confidence values 
to select one of a number of predetermined negotiating options. 

6. (AMENDED) A method according to claim 4 in which said step of negotiating 
based on said one or more confidence values comprises using said one or more 
confidence values to determine a numerical proposition which characterises an offer. 

7. (AMENDED) A method according to claim 1 which includes at least once 
performing the additional step of re-evaluating said one or more confidence values 
based on observed characteristics of said negotiation. 

8. (AMENDED) A method according to claim 1 comprising a step, before said 
step of deriving confidence values, of deriving at least some of the set of negotiating 
propositions based on characteristics of the negotiating environment. 

9. A method according to claim 8 in which the method includes a re-evaluation 
step of altering the one or more hypotheses, followed by a re-derivation of 
confidence values for the new set of hypotheses. 

10. A method according to claim 9 in which the re-evaluation step is performed 
upon detecting an inconsistency between the confidence values and new 
information, the re-evaluation eliminating the inconsistency with the new information. 

11. A method according to claim 1 0 in which said step of altering the one or more 
hypotheses includes evaluating the importance of new information, and altering the 
hypotheses in the case that the information is evaluated to be important. 

12. A method according to claim 1 1 in which the one or more hypotheses concern 
one or more of (i) characteristics of the bargaining power of one or more further 
negotiating parties, (ii) characteristics of agents involved in the negotiation (e.g. 
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based on past experience), or (iii) are based on types of goods or services which are 
a subject of the negotiation. 

13. (AMENDED) A method according to claim 1 further including a step of 
normalising the confidence values. 

14. (AMENDED) A method according to claim 1 in which, in addition to the one or 
more hypotheses, the negotiating propositions further include additional propositions 
which characterize the negotiation process, the additional propositions being in 
terms of numerical characterization variables, and the method including a step of 
setting the characterization variables. 

1 5. A method of monitoring a negotiation using an electronic communication 
network, in which a plurality of negotiating parties negotiate regulated by a set of 
negotiating propositions including one or more hypotheses, the method including 
identifying, by comparing the actual negotiation to the negotiating propositions, a 
characteristic of the negotiation. 

16. A method according to claim 1 5 in which the characteristic is a liability of the 
negotiation to inefficiency in time and/or revenue generated. 

1 7. (AMENDED) A method according to claim 1 5 including the further step of 
transmitted the characteristic to one or more of the parties, to cause that party to 
modify its behaviour. 

18. (AMENDED) A method according to claim 1 in which the parties are self- 
interested agents interacting using an electronic communication network. 

19. A method according to claim 18 in which the agents are automatic agents. 
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20. A method of linking available data and expected behaviour of self-interested 
agents interacting using an electronic communication network, the method employing a 
set of negotiating propositions characterizing a negotiating environment, the 
propositions including one or more hypotheses, and the method having the steps of: 

for each of said one or more hypotheses deriving a respective numerical 
confidence value, the or each confidence value representing confidence in the truth of 
the respective hypothesis; and 

linking available data and expected behaviour of said agents based on said one 
or more confidence values. 

21 . An apparatus for regulating negotiation between two or more negotiating parties 
which communicate using an electronic communication network, the apparatus having: 

means for storing a set of negotiating propositions characterizing a negotiating 
environment, the propositions including one or more hypotheses; 

means for deriving for each of said one or more hypotheses a respective 
numerical confidence value, the or each confidence value representing confidence in 
the truth of the respective hypothesis; and 

means for regulating the negotiation between said negotiating parties using said 
electronic communication network, based on said one or more confidence values. 

22. An apparatus for negotiating with one or more other negotiating parties by 
communication using an electronic communication network, the apparatus having: 

means for storing a set of negotiating propositions characterizing a negotiating 
environment, the propositions including one or more hypotheses: 

means for deriving for each of said one or more hypotheses a respective 
numerical confidence value, the or each confidence value representing confidence in 
the truth of the respective hypothesis; and 

means for electronically negotiating based on said one or more confidence 
values. 
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23. (AMENDED) An apparatus according to claim 21 which is electronically 
connected to the world wide web. 

24. (AMENDED) A computer program product readable by a computer device for 
causing the computer device to perform a method according to claim 1 . 
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ATTACHMENT B 

Marked Up Replacement Claims 



Following herewith is a marked up copy of each rewritten claim together with 
ail other pending claims. 

1 . A method of regulating negotiation between two or more negotiating 
parties which communicate using an electronic communication network, the 
method employing a set of negotiating propositions characterizing a 
negotiating environment, the propositions including one or more hypotheses, 
and the method having the steps of: 

for each of said one or more hypotheses deriving a respective 
numerical confidence value, the or each confidence value representing 
confidence in the truth of the respective hypothesis; and 

regulating the negotiation between said negotiating parties using said 
electronic communication network, based on said one or more confidence 
values. 

2. A method according to claim 1 in which the negotiating parties 
negotiate according to a set of rules, and said regulation includes varying the 
set of rules based on said one or more confidence values. 

3. A method according to claim 2 in which the set of rules are varied upon 
said one or more confidence values indicating a high likelihood of the 
negotiation reaching a predetermined disadvantageous condition. 

4. A method of negotiation with one or more other negotiating parties by 
communication using an electronic communication network, the method 
employing a set of negotiating propositions characterizing a negotiating 
environment, the propositions including one or more hypotheses, and the 
method having the steps of: 
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for each of said one or more hypotheses deriving a respective 
numerical confidence value, the or each confidence value representing 
confidence in the truth of the respective hypothesis; and 

negotiating based on said one or more confidence values. 

5. A method according to claim 4 in which said step of negotiating based 
on said one or more confidence values comprises using said one or more 
confidence values to select one of a number of predetermined negotiating 
options. 

6. (AMENDED) A method according to claim 4 or c l aim 5 in which said 
step of negotiating based on said one or more confidence values comprises 
using said one or more confidence values to determine a numerical 
proposition which characterises an offer. 

7. (AMENDED) A method according to any procoding claimj. which 
includes at least once performing the additional step of re-evaluating said one 
or more confidence values based on observed characteristics of said 
negotiation. 

8. (AMENDED) A method according to any procoding claimj. comprising 
a step, before said step of deriving confidence values, of deriving at least 
some of the set of negotiating propositions based on characteristics of the 
negotiating environment. 

9. A method according to claim 8 in which the method includes a re- 
evaluation step of altering the one or more hypotheses, followed by a re- 
derivation of confidence values for the new set of hypotheses. 

10. A method according to claim 9 in which the re-evaluation step is 
performed upon detecting an inconsistency between the confidence values 
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and new information, the re-evaluation eliminating the inconsistency with the 
new information. 

11. A method according to claim 1 0 in which said step of altering the one 
or more hypotheses includes evaluating the importance of new information, 
and altering the hypotheses in the case that the information is evaluated to be 
important. 

12. A method according to claim 1 1 in which the one or more hypotheses 
concern one or more of (i) characteristics of the bargaining power of one or 
more further negotiating parties, (ii) characteristics of agents involved in the 
negotiation (e.g. based on past experience), or (iii) are based on types of 
goods or services which are a subject of the negotiation. 

13. (AMENDED) A method according to any proooding claimj. further 
including a step of normalising the confidence values. 

14. (AMENDED) A method according to any procoding claimj. in which, in 
addition to the one or more hypotheses, the negotiating propositions further 
include additional propositions which characterize the negotiation process, the 
additional propositions being in terms of numerical characterization variables, 
and the method including a step of setting the characterization variables. 

15. A method of monitoring a negotiation using an electronic 
communication network, in which a plurality of negotiating parties negotiate 
regulated by a set of negotiating propositions including one or more 
hypotheses, the method including identifying, by comparing the actual 
negotiation to the negotiating propositions, a characteristic of the negotiation. 

16. A method according to claim 1 5 in which the characteristic is a liability 
of the negotiation to inefficiency in time and/or revenue generated. 
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17. (AMENDED) A method according to claim 15 or cla i m 16 including the 
further step of transmitted the characteristic to one or more of the parties, to 
cause that party to modify its behaviour. 

18. (AMENDED) A method according to any proood i ng claim J. in which 
the parties are self-interested agents interacting using an electronic 
communication network. 

19. A method according to claim 1 8 in which the agents are automatic 
agents. 

20. A method of linking available data and expected behaviour of self- 
interested agents interacting using an electronic communication network, the 
method employing a set of negotiating propositions characterizing a 
negotiating environment, the propositions including one or more hypotheses, 
and the method having the steps of: 

for each of said one or more hypotheses deriving a respective 
numerical confidence value, the or each confidence value representing 
confidence in the truth of the respective hypothesis; and 

linking available data and expected behaviour of said agents based on 
said one or more confidence values. 

21 . An apparatus for regulating negotiation between two or more 
negotiating parties which communicate using an electronic communication 
network, the apparatus having: 

means for storing a set of negotiating propositions characterizing a 
negotiating environment, the propositions including one or more hypotheses; 

means for deriving for each of said one or more hypotheses a 
respective numerical confidence value, the or each confidence value 
representing confidence in the truth of the respective hypothesis; and 



-4- 



marked claims 



means for regulating the negotiation between said negotiating parties 
using said electronic communication network, based on said one or more 
confidence values. 

22. An apparatus for negotiating with one or more other negotiating parties 
by communication using an electronic communication network, the apparatus 
having: 

means for storing a set of negotiating propositions characterizing a 
negotiating environment, the propositions including one or more hypotheses: 

means for deriving for each of said one or more hypotheses a 
respective numerical confidence value, the or each confidence value 
representing confidence in the truth of the respective hypothesis; and 

means for electronically negotiating based on said one or more 
confidence values. 

23. (AMENDED) An apparatus according to claim 21 or c l aim 22 which is 
electronically connected to the world wide web. 

24. (AMENDED) A computer program product readable by a computer 
device for causing the computer device to perform a method according to-afiy 
of claims 1 to 20 claim 1 . 
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METHOD AND APPARATUS FOR NEGOTIATING USING AN 



ELECTRO NIC COMMUNICATION NETWORK 



Field of the invention 



5 



The present invention relates to methods and 



apparatuses for trading using an electronic communication 
network. It further relates to computer program products 
carrying software for performing the methods. 

10 Background of the invention 
Z Z The phenomenal growth of the Internet and worldwide 

web in this last decade has been the driving force behind 
g^^k of electronic based trade and an explosion in 
m electronic commerce (e-commerce) applications. 
5 15 Electronic commerce can be loosely defined as the process 
if 1 of trade which takes place through computer mediated 
u electronic communication networks. Such systems can be 
further classified as "first generation** e-commerce 
systems, which are user-driven systems in which each user 
20 retains control of all trade related decisions, and 
"second generation" e- systems, in which each user 
delegates authority over some trade related decisions to 
an automatic agent (defined in software) . Software 
agents interact using a "protocol", to further their 
25 users 1 interests. 



e-commerce is only one example of a negotiation 



between self interested entities (human or software) 



which is carried out through computer mediated networks . 
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Second generation e-commerce systems are a special 
case of multi-agent systems (MAS) . Multi-agent systems 
can interact (once a protocol has been agreed) in an 
automated fashion. The use of mult i -agent systems is 
known in the fields of industry, entertainment, patient 
care, health planning and finance, and such systems are 
described, for example, in the article "Applications of 
Intelligent Agents" by N.R. Jennings and M. Wooldridge 
(1997) , available under electronic reference 
ht tp ; / / /www . springer . de/ comp/special / j ennings . pdf . 

The principal feature of the agents is to be "self- 
interested", that is each of the agents acts in a way 
which maximises its (or its users 1 ) goals. For example, 
considering a commercial transaction in which a customer 
wishes to place a long-distance telephone call, the 
customer may employ a self-interested agent which 
interacts with various telephone providers (other agents) 
to obtain the cheapest telephone supply. 

Furthermore , the Internet is emerging as the most 
efficient medium for carrying out business- to-business 
transactions, because it offers easy access to a large 
number of potential sellers and to their catalogues. The 
industry is also moving towards growing standardisation 
of communication inf rastructures over which different 
organisations can interact and safely carry out 
transactions, hence reducing the costs of communicating 
and doing business electronically. 
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With the increasing spread of the Internet, more 
and more commercial transactions are taking place 
electronically. Consumers purchase books and CDs, and 
businesses conduct electronic auctions of supply 
5 contracts. Electronic double auctions, such as Fastparts 
(http://www.fastparts.com/) , allow buyers and sellers to 
negotiate with each other. Some goods, such as software, 
can also be delivered via the net. The Internet, 
particularly the World Wide Web, is emerging as one of 
00 the most efficient media for carrying out business-to- 
15 consumer and business-to-business transactions. The 
o competitiveness of the Internet is likely to further 
y! increase: Agent technology could become for e-commerce 

what Windows was for PCs - a relatively simple and user- 
lT5 friendly way of using the new technology. In this 
\.\ framework individuals and organisation interact via the 
i" = network using software agents. A software agent (also 

automated, or autonomous agent) is a program that acts 

independently on behalf of its user and in of its 
20 interests. The main characteristic of these interactions 
is that the user delegates the authority to search, 

match, and even to transact business to the agent. 

An example of an interesting recent development in 
electronic commerce is the buying and selling 
25 electronically of the right to transmit data over the net 
and the telecommunications infrastructure. Organisations 
like Band-X ( http://www.band-x.com/) , RateXchange 
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( http : / /www, ratexchancre . com/) and Min-X 
( http: //pulver . com/min-x/) provide bulletin boards and 
double auctions to buy and sell bandwidth and connection 
time. Currently, these transactions are wholesale, 
between large operators. However, we could imagine such 
transactions taking place far more frequently. If 
negotiation were cheap and easy, and appropriate billing 
infrastructure was in place, re-negotiation of connection 
contracts could take place every few seconds. This would 
allow sources of traffic (such as local Internet service 
providers) to dynamically switch between long distance 
carriers in response to price fluctuations. In this way, 
a spot market for bandwidths could develop. 

One of the keys to making this happen is the 
ability to negotiate automatically. If negotiations are 
to take place constantly it would be expensive for people 
to perform the task. Furthermore, they will not always 
be able to react fast enough to changes in market 
conditions. For this reason, communications bandwidth 
has inspired work on automated negotiation from its 
inception. 

Summary of the invention 

The present invention seeks to provide new and 
useful methods and apparatuses for negotiating (e.g. 
trading) using an electronic communication network, and 
controlling an electronic communication network to 
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facilitate negotiation. 

In particular it may provide a method of linking 
available data and expected behaviour of self-interested 
agents interacting using an electronic communication 
network . 

In general terms, the invention proposes 
automatically forming hypotheses about the negotiating 
environment, with a numerical confidence level for the 
hypotheses (for example the confidence levels can be 
generated from observed negotiating behaviour and/or 
outcomes) , and negotiating or controlling negotiation 
based on the confidence levels. 

This formation of hypotheses may for example be by 
a system which is external to the negotiating parties and 
controls the protocol within which they negotiate (for 
example, to avoid unwanted behaviour of the collective 
system, such as the vulnerabilities described below) , 
Alternatively, the hypotheses may be used by one (or 
more) party to select its own negotiating strategy (i.e. 
self -regulation) to obtain behaviour which is maximally 
beneficial to that party (or those parties) . 

Thus, in a first aspect, the invention in general 
terms proposes that the hypotheses are used to regulate 
the way in which two or more other parties are permitted 
to interact. 

Specifically, the first aspect of the method is a 
method of regulating negotiation between two or more 
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negotiating parties which communicate using an electronic 
communication network, the method employing a set of 
propositions characterizing a negotiating environment, 
the propositions including one or more hypotheses, and 
5 including the method having the steps of: 

for each of said one or more hypotheses deriving a 
respective numerical confidence value, the or each 
confidence value representing confidence in the truth of 
the respective hypothesis,* and 
o 10 regulating the negotiation between said negotiating 

m parties using said electronic communication network, 

l5 based on said one or more confidence values . 
\fi For example, the negotiating parties may negotiate 

according to a set of rules, and the regulation may 
!il5 include varying the set of rules based on said one or 

more confidence values. This could either be a major 
O variation (e.g. fundamentally altering the type of 

auction occurring) , or a minor one (such as adjusting the 
increment in successive bids of an auction) . 
20 In a second aspect, the invention in general terms 

proposes that one or more negotiating parties employ the 
hypotheses to influence (regulate) their own trading 
behaviour . 

Specifically, in a second aspect the invention 
25 proposes a method of negotiation with one or more other 
negotiating parties by communication using an electronic 
communication network, the method employing a set of 
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negotiating propositions including one or more hypotheses 
concerning a negotiating environment, and including the 
steps of: 

for each of said one or more hypotheses deriving a 
5 respective numerical confidence value, the or each 

confidence value representing confidence in the truth of 
the respective hypothesis,* and 

negotiating based on said one or more confidence 
values . 

1310 The step of negotiating based on said one or more 

in confidence values may comprise using the one or more 
ij, confidence values to select one of a number of 
If? predetermined negotiating options. For example, it may 
;"" include deciding whether of not to participate in the 
•r!l5 negotiation at all; which other participants to negotiate 
1* 5 with (i.e. make an offer to}; or which of a predetermined 
P number of types of offer to make (e.g. an auction bid, a 
fixed price bid, or a request to another party to 
generate a bid itself) . 
20 Alternatively or additionally, the step of 

negotiating based on the one or more confidence values 
may comprise using the one or more confidence values to 
determine a numerical proposition which characterises an 
offer, e.g. a bid value may be calculated as a 
25 predetermined function of one or more confidence values. 

We will now describe preferable details of the 
generation and updating of the hypotheses and confidence 
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values which are relevant to both aspects of the 
invention. 

Preferably, the method includes at least once 
performing the additional step of re-evaluating said one 
or more confidence values based on observed 
characteristics of said negotiation. 

Preferably, the method includes a step (e.g. off- 
line before the on-line negotiation) of deriving the set 
of negotiating propositions in a way appropriate to the 
negotiating environment. This may include selecting the 
one or more hypotheses, to which confidence values are 
then assigned. 

Preferably, in addition to re- evaluation of the 
confidence value (s), the method includes a step (for 
example carried out in predefined circumstances) of re- 
evaluating the set of hypotheses itself, followed by a 
redefinition of confidence values for the new set of 
hypotheses. Thus, for example, if during the negotiating 
method the user of the method discovers an inconsistency 
between the confidence values and some new piece of 
information, the method may include re-evaluating the set 
of hypotheses to overcome the inconsistency. 

The negotiating propositions represent a 
classification based on underlying strategic form, or the 
rules of the game. In non-automatic negotiations failure 
to behave in a way which is consistent with these rules 
can be easily pointed out to the negotiating parties. 
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strategy. The present invention permits a technology 
which allows the same for automated negotiations.. For 
example, a party may identify propositions (either among 
the negotiating propositions, or derived from them) , 
5 which are expected to reach constant values during 

negotiation. If this is not achieved, the method detects 
the fact, and the party using the method can identify 
that the hypotheses are incorrect . 

Usually (though not necessarily) , the re- evaluation 
ii:10 of the set of hypotheses will increase the number of 
l£ hypotheses, but the method still preferably minimises the 

:*3 number of hypotheses in relation to the available data, 
jj. The hypothesis setting is preferably based on 

economic understanding of the relevant interactions. 
:;;15 Specifically, the set of hypotheses is based on the 
J r mathematical representation of the underlying strategic 

P structure of the interactions. Similarly, the updating is 
preferably based only on data which is relevant to the 
economic efficiency of these interactions. 
20 Preferably, the one or more hypotheses concern one 

or more of (i) characteristics of the bargaining power of 
one or more further negotiating parties and (ii) 
characteristics of agents involved in the negotiation 
(e.g. based on past experience) . If applicable, the 
25 hypotheses are also preferably defined based on types of 
goods or services being traded. 

Preferably, the method further including a step of 
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normalising the confidence values. For example, in the 
case that the hypotheses are mutually contradictory, the 
normalising step may include adjusting them so that their 
total value adds up to 1 . 
5 The hypotheses may fall into a number of groups. 

For example, one group of hypotheses may relate to the 
total number of negotiating parties (e.g. a first 
hypothesis that there is one other negotiating party, a 
second hypothesis that there are two, and a third 
=3 10 hypothesis that there are more than two) , while a second 
iB group of hypotheses may relate to the average size of 

^ other negotiating parties. In this case, a normalization 

J,. step may involve normalizing the confidence values of the 

; ~" hypotheses of one or more of these groups, 

jf 15 In addition to the hypotheses, the negotiating 

I- propositions may further include additional propositions 

U which characterize the negotiation process. For example, 
one such additional proposition may be whether the method 
is used for buying or for selling. The additional 
20 propositions may be in terms of numerical 

characterization variables. In this case, the method may 
include a step of setting the characterization variables 
(e,g. in the case of a selling process, the method may 
include a step of setting a characterization variable 
25 which represents the fact that method is selling, to 
,f l"). The additional propositions themselves may 
optionally be changed, if a party fundamentally 
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reassesses the negotiating environment* 

If a low-efficiency condition is identified, the 
method may include alerting one or more of the users to 
this fact, and preferably triggering a re-evaluation of 
5 the hypotheses and/or confidence values. 

Accordingly, in a third aspect, the invention 
provides a method of monitoring a negotiation using an 
electronic communication network, in which a plurality of 
negotiating parties negotiate regulated by a set of 

10 negotiating propositions including one or more 

hypotheses, the method including identifying, by 
comparing the actual negotiation to the negotiating 
propositions, a characteristic of the negotiation. 
For example, the characteristic may by the 

15 liability of the negotiation to inefficiency (in time 
and/or revenue generated) . This information may be 
transmitted to one or more of the parties, to cause them 
to modify their behaviour. Alternatively or additionally, 
as explained above, it may be used to modify a protocol 

20 which determines the rules within which the parties 
interact . 

In any of the aspects, the negotiating environment 
may be any situation in which more than one party 
negotiates, such as a commercial situation in which one 
25 or more suppliers trade to supply one or more goods or 
services to one of more buyers (e- commerce) . It also 
includes negotiations which are not specifically 
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concerning the supply of goods or services, such as a 
negotiation concerning timings for a meeting. 

Advantageous effects obtainable by the invention 

An example of the usefulness of the invention in 
its first aspect is for multi-agent systems composed of 
or including self interested agents are vulnerable, in 
the sense that problems may arise which significantly 
reduce the efficiency of the trading. 

Four examples of such vulnerability will now be 

given . 

Firstly, consider an agent which represents a 
customer which wishes to buy a good. If the agent 
insists on obtaining a low price for the goods (because 
it is programmed to do so) but communicates only with 
selling agents which are not allowed to negotiate prices, 
an impasse will be reached. The fruitless communications 
between the customer's agents and the selling agents use 
up network resources, and can thus significantly reduce 
the overall efficiency of the trading environment. 

Secondly, consider the case of two agents 
programmed to schedule a meeting between their respective 
users. If the two users have conflicting requirements 
concerning the time or place of the meeting, then a 
negotiation between the scheduling agents will be 
fruitless. If neither agent is willing to make a 
concession, then an impasse is reached, and the 
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communication has consumed network resources to no 
purpose . 

Thirdly, consider an on-line auction. In this 
case, the efficiency of the trading is determined, among 
other factors, by the revenue which is generated for the 
sellers. A variety of protocol types can be identified, 
such as so called "English auctions" or 11 first-price 
sealed-bid" auctions. The revenue generated generally 
depends on the type of protocol, but which protocol type 
maximises efficiency can depend on the characteristics of 
the auction (for example on whether the goods being sold 
can be re- sold) . If the sellers and buyers have a mis- 
matched understanding of this underlying structure, then 
the auction is unlikely to be efficient. 

Fourthly, consider a market for goods such as 
electronic components. Conventionally in such a market 
both sellers and buyers post prices and trade takes place 
when those prices match. What constitutes optimal 
behaviour for the trading agents depends on the ratio 
between the quantity of goods demanded and the quantity 
supplied. Specifically, if only one agent is selling a 
certain component and many agents demand that component, 
then the seller can expect to extract much of the surplus 
for itself. On the other hand, if supply greatly exceeds 
demand, the buyer should be able to extract most of the 
surplus. Thus, if the agents of the sellers and buyers 
are not sensitive to the ratio of supply and demand, 
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their expectations may mis-match and impasses of the kind 
described above may occur. 

In a multi-agent systems, as opposed to other 
distributed computer systems, there is no control over 
the behaviour of individual agents, except through the 
protocol. Currently because of the risk of 
inefficiencies, these systems maintain the option of 
intervening and dictating agreements. This is highly 
undesirable (since it goes against the main motivation 
for using MAS) . Also, in the long run agents can learn 
to anticipate that the system will intervene, and change 
their behaviour accordingly, causing even more 
inefficiency. For example, a party which believes it 
will be better off if the system intervenes will 
deliberately make negotiations inefficient to ensure 
intervention by the system. 

In the first aspect as defined above, the invention 
may attempt to reduce the vulnerability of a multi-agent 
system. The method may be carried out, for example, to 
influence the protocol, or even as part of the protocol. 

As for the second aspect of the invention, for 
agents to be fully autonomous, they must be able to learn 
and adjust to changing circumstances. Agents will choose 
their bids on-line based on current information from the 
user (e.g. maximal willingness to pay, priority of 
achieving trade) and on past observations. For example, 
an agent selling bandwidth is required to strike a 
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balance between submitting a high asking price (to 
increase profits) , and insuring a high probability of 
reaching deal (by not asking for a price which is too 
high) . The current invention can be used by agents 
5 trading in automatic markets for bandwidth, providing 
them with on-line information regarding the underlying 
strategic structure of these interactions, hence allowing 
them to choose their asking price optimally. 

The invention can be used for other types of 
10 business- to-business interactions. To see how, notice 

that Internet -based commerce may come very close to Adam 
Smith's vision of free markets where an "invisible hand" 
co-ordinates prices so as to equate supply and demand of 
all goods and services. For markets to become 
15 competitive, according to Smith's vision, prices must be 
flexible enough so that supply and demand can adjust to 
each other and to changing circumstances. In light of 
this it is not surprising that on-line auctions are 
emerging as an important feature of e-markets: Sellers of 
20 goods and services are favouring using auctions to 

offering fix-price tariffs. Auction provides for sellers 
an efficient method of offering a fully flexible price 
without the disadvantages associated with price haggling 
and direct negotiations. Moreover, it allows sellers to 
25 "play" potential buyers against one another hence, in 
many cases, maximising sellers* potential profits. 
Double auctions (where sellers and buyers both post 
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prices) are also used in some cases, but the bulk of the 
trade is carried out using one-sided auctions which 
empower only the seller. 

Given the background, buyers now require the 
5 appropriate technology to empower them in response to 

these changes. New issues now arise, which are not 
supported by existing Automated Procurement (AP) Systems, 
or Manufacturing Resource Planning (MRP) systems. What, 
for example, should the buyer do if not all required 

10 quantity can be obtained from one source? What if what's 
on offer satisfies only some of the buyer's requirements 
(for example, it may be cheap, but the quality and after- 
sales services may not be as good as that of another, 
more expensive, seller)? How should the buyer bid if she 

15 participates in several on-line auctions? 

These issues are significant even if the number of 
potential suppliers is relatively small: If not all 
prices are fixed, then the organisation will require IT 
which integrates existing applications (e.g. AP and MRP 

20 systems) with a strategic reasoner based on an economic 
understanding of the market. By integrating the 
procurement system, the search & match, and seller 
negotiations, with the strategic reasoner, it becomes 
possible to effectively address questions like who to buy 

25 from and how much, how to bid in an auction, given the 
current best available fixed price, and so on. 

The current invention can be used by corporate 
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buyers as the basis for making strategic choices 
regarding: Who to buy from? How much to buy from each of 
these sellers? And, should the organisation try to 
negotiate a better deal, and if so how? 

The invention provides vital information to the 
purchaser. Moreover, the type of strategic 
considerations considered by the invention is otherwise 
very hard to obtain. We now explain why a strategic 
classification is so important for corporate buyers faced 
with a number of dynamic market mechanisms (i.e. 
mechanisms where the price is not fixed, like auctions) . 

In a fixed pricing world, sellers set prices, and 
trade with buyers who value the goods at more than the 
asking price. Prices are then determined by sellers' 
costs and by competition from other sellers. In a world 
of no fixed prices, everything is negotiable. In general 
who pays what will depend on the bargaining powers of the 
negotiating parties. By carrying out an auction, the 
seller is able to abstract from direct negotiations, and 
gain most of the "negotiations surplus" to itself, by 
playing potential buyers against one another. Unlike 
bus ine s s - 1 o - consumers auctions (like eBay.com), where 
collectables are traded, sometimes at what seems like 
bargain prices, business-to-business auctions are carried 
out solely to increase the revenues of sellers. 

Decision making in such dynamic environment is 
extremely complex. Purchasing decisions are hard enough 
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in a stable environment with a fixed number of approved 
vendors, and with fixed pricing. In an open environment 
with sem-dynamic pricing, purchasing decisions are simply 
too complex to be handled without IT support . To 
5 illustrate this point consider the example of an 

organisation which normally buy from the cheapest amongst 
its of 5 approved vendors. Using the Web, the 
organisation identifies 5 more potential sellers. Since 
there are no fixed prices, the purchaser will need to 
10 consider combination like "buy X units from A, Y units 

from B, and the rest from C" . With 10 sellers there are 
2 10 = 1024 combinations, or subsets, of sellers to 

consider. But since the purchaser needs to decide what 
quantity to buy from each seller, it is easy to see that 
15 1024 is in fact a very conservative estimate for the 
number of alternatives to be considered. 

Another considerations which complicated purchasing 
decisions are: 

20 • Action-Reaction: The outcome of a decision to buy 

from A rather than B, will depend on how A and B 
react. For example, it will not be wise to lose 
the "valued customer" status, for a small, one-off 
discount. Similarly, how much to bid in an auction 
25 will normally depend on how much the other buyers 

are likely to bid. These types of speculations can 
considerably increase the complexity of making 
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buying decisions. 
• Multi-attributes: Most business- to-business 

transactions depend not only on price, but also on 
other attributes like quantities available, quality 
5 assurances, guaranteed time to delivery, after-sale 

support and so on. Each option of where and how 
much to buy will need to be evaluated using a 
multi -dimensional scale which weigh the various 
relevant attributes according to the organisation 

=;;:10 preferences. Once more, this increases the 

Sj complexity of the decision rule. 

Complexity can explain much of the rigidity (or friction) 

■ p commonly observed in business- to-business trading. 

^15 Organisations tend to continue buying from the same 
:Z, suppliers because it is too costly and difficult to 

continuously engage in new search and match or in re- 
negotiation. But this is normally bad for the 
organisation: Every time the approved sellers cannot 
20 match current needs, organisations end up buying off- 

contract, losing out on volume discounts, pre -negotiation 
agreements and so on (these of f- contracts purchases are 
known in the industry as "maverick purchasing") . From 
the $1.4 trillion spent annually on MRO purchases in the 
25 US (according to Purchasing Magazine) , an estimated 40% 

is purchased of f -contract ! 

The invention can be set-up by a corporate buyer to 
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control purchasing decisions in its specific market (for 
example buying manufacturing materials) . Once set-up, 
the invention automatically updates relevant changes to 
the market, and can be used to give on-line economic 
5 advice to the organisation, recommending buying 
strategies. This can significantly reduce the 
inefficiencies described above. 

The negotiation may employ both the first and 
second aspects of the invention. That is, an automatic 
10 regulation of the overall negotiation (e.g. via the 

protocol) by an operator of the negotiation (e.g. the 
"central" operator of the web site at which the 
negotiation is occurring) , and an automatic self - 
regulation of the negotiating strategy of one or more 
15 parties. Optionally, one or more of the parties may share 
reasoning (generating of the propositions and the 
confidence values) with each other, or with the "central" 
operator. 

The invention is suitable in the case that the 
20 negotiating parties are all linked to a web, such as the 
world wide web, and that the electronic communication is 
via this web. 

In further aspects, the invention provides 
apparatus for performing the methods of the invention. 
25 Such an apparatus may be adapted to perform a method 

having any of the optional features described above in 
relation to the first and second aspects of the 
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invention . 

In a further aspect, the invention provides a 
computer program product, such as a computer- readable 
electronic data carrier, carrying a program for 
performing any of the methods described above. 

Non- limiting examples of the invention will now be 
described for the sake of illustration. 

Brief Description of the Figures 

Fig.l is a schematic diagram of a first embodiment 
of the invention in which a protocol of the interactions 
of a plurality of agents is regulated; 

Fig. 2 shows the system of Fig. 1 as connected 
hardware units; 

Fig. 3 shows an application of the system of Fig. 1 
in relation to an auction; 

Fig. 4 is a flow diagram in an embodiment of the 
invention; 

Fig. 5 is an example of the logical stages in an 
embodiment of the invention; 

Fig. 6 shows an embodiment of the invention in 
which a single trader uses a reasoning device to regulate 
its own trading behaviour; and 

Fig. 7 represents the flow of information in the 
diagram of Fig. 6, as the invention is used by a single 
corporate buyer. 
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Description of the Preferred Embodiments 

The first four examples of the invention relate to 
the embodiment of the first aspect of the invention shown 
in Fig. l. A plurality of agents (labelled l, . . , N) 
interact via a protocol 5. The protocol is determined, 
or at least influenced, by numerical outputs of the 
reasoning system 7. The operation of the reasoning system 
7 will now by described. 

Fig. 2 represents portions of the hardware used to 
support the system illustrated in Fig. 1. The reasoning 
system and protocol may, as shown, by supported on the 
same computer, e.g. a unix server. 

Fig. 3 shows an example of the use of the system in 
Fig. 2 in the context of an on-line auction. 

We will now describe the logical operations 
performed by the reasoning system of Fig. 1. These 
explanations are explained in overview in Fig. 4, and in 
a more detailed example in Fig. 5. 

S is defined as the set of all possible states 
(including hypotheses, and optionally also additional 
propositions characterizing the negotiation) . The set of 
confidence values (and characterization variables for the 
additional propositions) are here represented by a set P 
(there is a value of P for each of the hypotheses in S) . 
The off-line algorithm initiates P. We can then define 
S'={s e S; p(s) > 0} , i.e. S* is the set of all states 
which have a positive probability. 
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Another set T is defined {which we will expect to 
attain equilibrium behaviour and outcomes during 
negotiation according to the methods of the invention) . 
The set T is normally much smaller than S (i.e. the 
number of elements is smaller) . For each proposition in 
S, there is at least one link to a state in T, which 
carries a certain weight on it. This represents a likely- 
causal relationship. For example, in a double auction 
j="No lf (no big player present), is linked to the state 
"Competitive outcome" in T with a large probability. 

Because the number of states in T is smaller than 
S, most states in T have several links leading to them 
from different states. This creates a relationship 
between states in S, which is based on the similarity of 
the equilibrium outcomes. 

Once P is set (and at any given stage after P is 
updated) : 

(1) The probability of an individual state is given by 
the product of the probabilities in each of the 
categories . 

(2) The probability of a set of state is equal to the sum 
of the probabilities of the individual states in that 
set. 



(3) The probability of the states in T is obtained in the 
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following way: For each state, t f in T, we compute cp(t f ) 
- the sum of the probabilities of the states in S which 
link to this state, multiplied by the weights of these 
links. We then define the probability of state t' as 

L c p(0 

Therefore, after each iteration (i.e. updating of the p 
values) the system has a probability distribution over 
the outcomes and equilibrium behaviour it expects to 
observe . 

There are two types of updating procedures : 
Updating propositions based on new information (the 

value of some of the propositions which are "on-line" 

will become known, for example the number of bidders) . 

This should be a straightforward updating of P (and 

therefore of S ! ) . 

Updating based on observed equilibrium outcome or 
behaviour (this is not directly done by the system. The 
protocol can inform the system that certain behaviour is 
observed. The system, however, responds to such input by 
the following procedure) . Here, we work backwards, and 
update all the states in S which link to the state in T 
which is now being updated. This could be negative (i.e. 
a state in T has a higher weight than observed) or 
positive (i.e. a state in T has a lower probability from 
what is observed. On the extreme, a state which currently 
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has zero probability had occurred) . 

The first type of updating, (normally) updates the 
P values associated with the states in S 1 . It cannot 
enlarge S*, but could, in some cases make it smaller by 
setting the probability of one or more of the states in 
S T to zero. 

The second type of updating (and sometimes also the 
first, although this would mean that the wrong data was 
given off-line), can lead to updating S 1 itself, by 
recognising that a state (or a set of states) , which is 
not included in S 1 (i.e. not anticipated by the system) 
is now likely. 

Throughout the off-line setting of P, if a "don't 
know" answer is given, it is possible to include a 
procedure which investigates the matter further by case- 
base matching (for example, if a "don't know" answer is 
given for the value of the good traded, then we can use 
the fact that all kinds of consumption goods, like foods, 
are private value and so on) . 

More specifically, the updating procedure is as 
follows : - 

l. At the end of the off-line stage, the protocol 

(user) receives a set of states, S; a probability 
distribution P over that set; a set T ; and a 
probability distribution p(T) over the set T. 

2 . New information about P may become available to the 
protocol at the on-line stage (for example, the 
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number of bidders may have been unknown in advance, 
but becomes known on-line) . The protocol can 
transmit this new information to the invention, 
which in turn updates P and p(T) accordingly. 
The above described new information is transmitted 
by the protocol (user) to the invention (system) in 
the form of new numerical values, the v's or w's, 
describing the probabilities of certain propositions 
(e.g. new probabilities for the number of bidders) . 
In addition to new information about P, the protocol 
can transmit to the invention updated information 
regarding observed negotiating behaviours and/or 
observed outcomes of negotiations, i.e. information 
regarding p (T) . 

This new information about p(T) can be used by the 
invention for backward updating of P and p(T) (as 
described below) . 

Once again, the above described new information is 
transmitted by the protocol to the invention using 
numerical values {either v's or w's) describing the 
observed likelihoods of states in T. 
Both the v's and the w's serve the same purpose: 
transmitting new information to the invention. The 
main difference between the two is the following: 
a) The protocol (user) may wish to completely re- 
write existing values in P (or p(T)), for example if 
the protocol learns that the number of bidders in 
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the on-line auction is, say, 6, then it can set 
P ( j="4-10") =1 hence overwriting any existing values 
for j. In this case the protocol uses the Vs. 
b) The protocol may wish to update existing values, 
rather than replace (this is likely when continuous 
and gradual updating takes place. It is also the 
more 'natural' way to update p (T) ) . In this case 
the protocol uses the w's ("w" for "weight"), which 
are then used by the invention as weights for 
updating existing values in p, or in p(T) (as 
explained below) 



Example 1: Double auction 



A double auction is a marketplace where sellers and 
buyers post demand and supply functions (for example, 
"willing to buy 7 units at price", "selling at X per unit 
up to 2 0 units, and Y per unit for 2 0 or more") . 

(1) States of the world: S(i, j, k, 1, m, n) = 5x2x3x2x4x2 
=48 0 states, in a six dimensional array. 

Propositions : 

i: Ratio of buyers to sellers, 5 states: 1 to 1, 1 to 2 
or more, ratio smaller than one third, ratio between one 
and two thirds, ratio greater than two thirds, 
j: Presence of "big" players, 2 states: Yes, No. 
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k: Value of object or service, 3 states: Private value, 
common value, correlated value. 

1: Repeated interactions, 2 states: Yes, No (or not 
significant) 

m: Outside option, 4 states: Yes for all, Only for 
Sellers, Only for buyers, No for all. 
rii Capacity constraints, 2 states: Significant, Not 
significant . 



The set T: 

t l : Symmetry between buyers and sellers 

t 2 : Asymmetric - buyer side more competitive 

t 3 : Asymmetric - sellers side more competitive 

t 4 : Competitive outcome expected 

t 5 : Non- competitive outcome expected 

t 6 : Reputation and history dependent strategies likely 



(2) Initiating P: Through off-line algorithm below. 

Question: Enter the estimated number of buyers and 

sellers (the program then computes A=abs (#sellers minus 

#buyers) /max (#sellers , #buyers) 

Answer: 1 to 1 Action : Set p (i= "1-1" ) =1 

Answer: 1 to 2+ Action : Set p (i="l-2+") =1 

Answer: A<l/3 Action : Set p (i = "<l/3") =1 

Answer: l/3<A<2/3 Action : Set p (i="l/3<2/3 ,f )=l 
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Answe r: A>2/3 Action : Set p ( i=" >2/3 " ) =1 

Answe r: Don't know Action : Set 5*p ( i= "1-1" ) =3*p ( i= "1- 

2+")- p(i=»<l/3")=2*p 
(i="l/3<2/3" ) =2*p (i=">2/3") 
Answer: Manual Action : Set i. 

Answer: On-line Action: Set 5*p (i="l-l n ) = 3*p (i="l-2+") = 

p(i="<l/3") =2*p(i="l/3<2/3") 
=2*p (i=">2/3 n ) 
Set On-line=On-line w {i} 



Ui Question : Are there "big" players present? 
U Answer: Yes Action : Set p ( j = "Yes " ) =1 

Answer: No Action : Set p(j="No")=l 

l=j Answe r: Don't know Action : Set 2*p ( j = "No" ) =p ( j = tf Yes" ) 
IS Answer : Manual Action : Set j . 

I=K Question : What is the value of the object or service 
traded? 

Answer: Private Action : Set p (k=" Private" ) =1 

20 Answer: Common Action : Set p (k= "Common" ) =1 

Answe r : Correlated Action : Set p (k= "Correlated" ) =1 
Answer: Don't know Action : Set p (k="Private" ) =10*p 

(k=" Common") =10/9*p 
(k="Correlated") 
25 Answer: Manual Action : Set k. 

Answer: On-line Action : Set p (k=" Private" ) =10*p 

(k=" Common") = 
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1 0 / 9 *p ( k= " Correlated " ) 
Set On-line=On-line kj {k} 

Question ; Repeated Interaction? 

Answer : Yes Action : Set p (1= "Yes" ) =1 

Answer : No Action: Set p(l= M No" ) =1 

Answe r : Don't know Action : Set 4*p (l="No" ) =p (l= ,f Yes ,T ) 

Answer : Manual Action : Set 1. 



Question : Outside option? 



Answer: Yes to all 
Answer : Sellers only 
Answe r : Buyers only 
Answe r : No to all 
Answe r : Don 1 1 know 



Answer: Manual 
Answer : On-line 



Action : Set p (m=" YAH" ) =1 
Action : Set p (m= M Sellers fI ) =1 
Action : Set p (m= "Buyers » ) =1 
Action : Set p (m= "NAll " ) =1 
Action : Set p (m= " Yall " ) = 3*p 
(m= n Sellers") = 3*p 
(m= Tf Buyers" ) =p (m="NAll M ) . 
Action : Set m. 
Action : Set p (m="Yall" ) =3*p 
(m= "Sellers" ) = 3*p 
(m= "Buyers ") =p (m= "NAll") . 
Set On-line=On-line u {m} 



Question : Capacity constraints? 
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Answer: Significant Action ; Set p (n="Sign" ) =1 

Answer: Not significant Action : Set p(n="No")=l 
Answer: Don't know Action : Set p (n= 11 Sign" ) =p 

(n= "No ") 

Answer: Manual Action : Set n. 

Answer: On-line Action : Set p (n= "Sign" ) =p 

(n= "No ") 

Set On-line=On-line {n} 



10 To explain the notation used here, and in the remainder of 

the document, when a proposition has two possibilities, each 
described by a respective confidence value p, and we say 
that the value of p for one of those possibilities is set to 
0 or 1, it is to be understood that the value of p for the 

15 other of those possibilities is respectively set to 1 or 0 . 
More generally, in the invention during the initiation of 
confidence values, they are preferably initiated so as to be 
normalised. Thus, for example, when it is stated above that 
we set 2*p ( j = "No" ) =p ( j="Yes") , we mean that p(j = "No") is set 

20 to 1/3 and p(j = n Yes ,! ) is set to 2/3. Similarly, when we say 
that we set p (k= rf Private" ) =10*p (k= !, Common n ) =10/9*p 
(k= "Correlated" ), -we mean that p (k= fr private" ) is set to 
p (k=" Common" ) is set to 1/2 0, and p (k=" Correlated" ) is set 
to 9/20. 

25 

Stage 2: Set the following links: 



FROM: i=»l-l» 
FROM: i="l-l T1 



TO: t a WEIGHT: 0.5 

TO: t 4 WEIGHT: 1 
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FROM: 


i="l-2+" 


TO: 


t 2 


FROM: 


i="l-2+" 


TO: 




FROM: 


i="<l/3" 


TO: 


t 2 


FROM: 


i="<l/3" 


TO: 


t 4 


FROM: 


i="l/3<2/3" 


TO: 


t 2 


FROM: 


i="l/3<2/3" 


TO: 


t 3 


FROM: 


i="l/3<2/3" 


TO: 


t 4 

H 


FROM: 


i=">2/3" 


TO: 


to 


FROM : 


i=">2/3 TT 


TO: 


t 3 


FROM: 


i=">2/3" 


TO: 


t 5 


FROM : 


j=" Yes" 


TO: 


^- s 


FROM: 


j="Yes" 


TO: 


u 


FROM : 


j="No" 


TO: 


t 4 


FROM: 


k=" Private" 


TO: 




FROM : 


k= M Common 11 


TO : 


t s 


FROM: 


k= "Correlated 


"TO: 


t 5 


FROM: 


l="Yes" 


TO: 




FROM: 


l="Yes" 


TO: 


t« 


FROM: 


l=»No" 


TO: 


t 4 



WEIGHT: 0.8 

WEIGHT: 0.8 

WEIGHT: 0.8 

WEIGHT: 0.9 

WEIGHT: 0.5 

WEIGHT: 0.5 

WEIGHT: 0.5 

WEIGHT: 0.9 

WEIGHT: 0.9 

WEIGHT: 0.9 

WEIGHT: 0.8 
WEIGHT: 0.8 
WEIGHT: 0.5 

WEIGHT: 0.7 
WEIGHT: 0.8 
WEIGHT: 0.6 

WEIGHT: 0.8 
WEIGHT: 1 
WEIGHT: 0.5 
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FROM: 


m= 


n YAH" 


TO: 




WEIGHT: 


0 


.7 


FROM: 


m= 


"Buyers" 


TO: 


t 3 


WEIGHT: 


0 


.9 


FROM : 


m= 


"Sellers" 


TO: 


to 


WEIGHT : 


o 


. 9 


FROM : 


m= 


"NAll" 


TO: 


ti 


WEIGHT: 


0 


. 5 


FROM: 


m= 


"NAll" 


TO: 


t« 


WEIGHT: 


0 


.6 


FROM: 


n= 


"Yes" 


TO: 


t s 


WEIGHT: 


0 


.8 


FROM: 


n= 


"No" 


TO: 


t< 


WEIGHT: 


0 


.5 



(3) Updating rules: 
Type I : 

These will be described later. 
Type II : 

These will be described later. 

Example 2: Scheduling (one-to-one negotiations) 

(1) States of the world: S (i, j , k, 1 , m) = 3x3x2x2x3 = 108 
states, in a four dimensional array. 

Propositions : 

i: Outside option, 3 states: none/one of the players/both 
players . 
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j: Deadlines, 3 states: none/ one of the players /both 
players . 

k: Patience attitudes, 2 states: significant 
differences/no significant difference, 
i: Repeated interactions, 2 states: yes/no. 
m: Strategic complimentarities , 3 states: no 
conflict/some conflict/opposite preferences. 

The set T: 

t 1 t Extreme ex-ante asymmetry (no bargaining) 

t 2 : Ex-ante asymmetry (both sides have some bargaining 

power) 

t 3 : Symmetric ex ante bargaining 

t 4 : Value of surplus compared to value of deal significant 
t 5 : Value of surplus compared to value of deal not 
significant 

t 6 : Reputation and history dependent strategies likely 



(2) Initiating P: Through off-line algorithm below. 



Question : Outside option? 

Answer: None Action : Set p (i="None" ) =1 

Answer: One of the players Action : Set p (i="0neSide" ) =1 

Answer: Both players Action : Set p ( i= "Both" ) =1 

Answer: Don't know Action : Set p ( i= "None" ) =p 

(i="OneSide") =p (i="Both") 

Answer : Manual Action: Set i. 
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Action : Set p (i = "None ,! ) =p 

(i= ,r OneSide " ) =p (i="Both ,! ) 
Set On-line=On-line ^ {i} 



Question : Deadlines? 

Answer: None Action : Set p ( j = "None" ) =1 

Answer: One of the players Action: Set p ( j = "OneSide" ) =1 



Answe r : Both players 
Answe r : Don ' t know 



Answer : Manual 
Answer : On-line 



Action : Set p ( j = "Both" ) =1 
Action : Set p ( j ="None" ) = 3*p 

( j = "OneSide n ) =3*p 

(j = f, Both") 
Action : Set j . 
Action: Set p ( j = "None" ) =p 

( j = " OneSide" ) =p { j = "Both" 
Set On-line=On-line o {j} 



Question: Patience attitude of bargaining parties? 



Answer: Significant difference Action : Set p (k="Sign" ) =1 
Answer: No significant difference Action : Set p (k= "No" ) =1 
Answer: Don't know Action : Set p (k="No" ) = 3*p 

(k=»Sign") 

Answer: Manual Action : Set k. 

Answer : On-line Action : Set p (k="No" ) = 3*p 

(k="Sign" ) 

Set On-line=On-line 
^{k} 
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Question : Repeated interactions? 

Answer : Yes Action : Set p (1= "Yes" ) =1 

Answer : No Action : Set p ( 1= "No" ) =1 

Answer: Don't know Action : Set 4*p ( 1- "No" ) =p (1= " Yes " ) 

Answer: Manual Action : Set 1. 



Question : Strategic complimentarities? 

Answer : No conflict Action : Set p (m="NoConf " ) =1 

Answer: Some conflict Action : Set p (m= "Mix" } =1 

Answer: Opposit preferences Action : Set p (m="Opp" ) =1 
Answe r : Don't know Action : Set p (m=="NoConf " ) =p 

(m="Mix") =p(m= ,, Opp" ) 
Answer : Manual Action : Set m. 

Answer : On-line Action : Set p (m=="NoConf " ) =p 

(m= "Mix" ) =p (m="Opp rf ) 
Set On-line=On-line {m} 



Stage 2: Set the following links: 



FROM: i=»None rt 

FROM: i="0neSide" 

FROM: i= n 0neSide" 

FROM: i="Both" 



TO: t 3 

TO: ti 

TO: t 2 

TO: t 3 



WEIGHT: 0.8 

WEIGHT: 0.2 

WEIGHT: 0.5 

WEIGHT: 0.8 



FROM: j = "None" TO: t, 

FROM: j="0neSide" TO: t n 
FROM; j="OneSide" TO: t 2 



WEIGHT: 0.8 
WEIGHT: 0.2 
WEIGHT: 0.5 



SUBSTITUTE SHEET (RULE 26) 



WO 00/25242 



PCT/GB99/03528 



FROM: j="Both" 



TO: t, 
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WEIGHT: 0.8 



FROM: k="No 1 ' 
FROM: k= f! Sign" 
FROM: k=»Sign" 



TO: t 3 
TO: t a 
TO: t 2 



WEIGHT: 0.8 
WEIGHT: 0.2 
WEIGHT: 0.5 



FROM: l=»Yes H 
FROM: m="NoConf" 
FROM: m^" Some 11 
FROM: m= "Some" 
FROM: m= "Opp tf 



TO: t 6 
TO: t 5 
TO: t 4 
TO: t 5 
TO: t. 



WEIGHT: 0.8 
WEIGHT: 1 
WEIGHT: 0.2 
WEIGHT: 0.2 
WEIGHT: 1 



(3) Updating rules: 

Type I : 

These will be described later. 



Type II : 

These will be described later. 



Example 3: On-line auction houses 

An on-line auction is a situation where one seller (or 
buyer) , sells (or buys) a good or service through an 
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auction protocol, to 2 or more potential buyers 
(sellers) . 



Auctions are among the simplest cases of a trading 
environment because there are only a relatively small 
number of factors which influence the underlying 
incentive structure of participating agents. 
(1) Defining states of the world 

To set up the example we consider a model of the world 
(the trading environment) in which the states of the 
world are given by a seven dimensional array S(i, j, k, 
1, m, n, o, p) . Addressing these variables in turn, 

-Index i (which has two states) represents whether 
the method is used for buying or selling? 
-Index j represents the number of other parties 
{buyers or sellers)? Index j is an integer which 
can take 5 values (representing whether the number of 
players is 2, 3, 4-10, 11-20, or 21 or more) . 
-Index k represents whether there big players, or 
only small? Thus, k has 2 states. 

-Index 1 represents whether an object or a service 
is being traded. It thus has 2 states. 
-Index m has 3 states and labels whether the goods 
are single unit, multi-unit sold sequentially or 
multi-unit sold simultaneously? 

-Index n represents whether value is private value, 
common value, or correlated value? It has 3 states. 
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-Index o represents whether trading is made up of 
repeated interactions (in a way that matters) . Index 
n has 2 states. 

-Index p represents whether there is a outside 
option (e.g. competition between auctions) It has 2 
states: Yes, No (or not significant). 

Thus there are 2x5x2x2x3x3x2x2 = 1440 possible world 

states . 

Set T: 

txi Competitive environment 

t 2 : Non- competitive environment 

t 3 ; Surplus extraction possible 

t 4 : Reputation and history dependent strategies likely. 
(2) Initiating P: Through off-line algorithm below. 



20 



25 



Question : Buying or Selling? 

Answer: Buying Action : Set p (i = TT Buying " ) =1 

Action : Set p (i="Selling w ) =1 
Action : Set i. 
Action : Set p buying ") =p 
(i= ,f selling") 
Set On-line-On-line \u {i} 

Question : Number of bidders 2 , 3 , 4-10 , 11-2 0 , more than 20? 



Answer: Selling 
Answer : Manual 
Answer: On-line 
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Answer : 3 
Answer : 4-10 
Answer ; 11-20 
Answer : 20+ 
Answer ; Manual 
Answer: On-line 
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Action : Set p (j = tr 2 lf ) =1 
Action : Set p(j = rT 3")=i 
Action : Set p ( j="4-10" ) =1 
Action : Set p ( j = "ll-20 n ) =1 
Action : Set p ( j=»20+" ) =1 



Action : Set j . 

Action: Set p { j = »2 » ) =p ( j =" 3 » ) =p ( j = « 4 - i0 * ) 
=p(j = "ll-20") =p(j = »20+<») 
Set On-line=On-line o {j} 
Answer: Don't know Action: Set P ( j = "2 << ) =p ( j = »3 » ) =p ( j = " 4 - 

10»)=p(j = "ll-20»)=p(j = "20+«) 



Question: Are there big players present? 

Alls wer - Ye s Action : Set p(k="No")=0 

Answer : No Action : Set p{k="Yes")=0 

Answer: Don't know Action : Set 5*p (k=»Yes») =p (k=«No») 

Question: Object or Service? 

Answer: Object Action : Set p (l="Service» ) =0 

Action : Set p ( 1= "Ob j ect " ) =0 
Action : Set j . 

Action: Setp(l=»Service")=p (l=»0bject») 
Set On-line=On-line {1} 



Answer: Service 
Answer : Manual 
Answe r: On-line 



SUBSTITUTE SHEET (RULE 26) 



10 



WO 00/25242 PCT/GB99/03528 

41 

Question : Single unit, multi-unit sold simultaneously, 
multi-unit sold sequentially? 

Answer: Single Action : Set p (m= 11 Single " ) =1 

Answer: Multi-sim Action : Set p (m= "Multi-sim" ) =1 
Answer: Multi-seq Action : Set p (m="Multi-seq" ) =1 
Answer: Manual Action : Set m. 

Answer: On-line Action: Set p (m=" Single" ) = p(m= "Multi- 

sim" )= p (m= "Multi-seq" ) 
Set On~line=On-line o- {m} 



■ J Question : Private , common or correlated value? 
H Answer : Private Action s Set p (n=" Private" ) -1 

^ Answer : Common Action : Set p (n= ,! Common 11 ) =1 

Answe r : Correlated Action : Set p (n= "Correlated" ) =1 
1|L Answer : Manual Action : Set n. 

U Answer: Don't know Action : Set p (n= "Private" ) = l0*p 

(n="Common" ) =10/9*p 
{n= "Correlated" ) 
Answer: On-line Action : Set p (n="Private" ) =10*p 

20 (n=" Common" ) =10/9*p 

(n="Correlated") 
Set On~line=On-line kj {n} 

Question : Repeated game? 
25 Answer : Yes Action : Set p (o="No" ) -0 

Answer : No Action : Set p (o="Yes" ) =0 



SUBSTITUTE SHEET (RULE 26) 



WO 00/25242 PCT/GB99/03528 

42 

Answer: Manual Action : Set o. 

Answer; Don't know Action : Set p (o="No" ) =10*p (o="Yes" ) 

Question : Competition with other auction sites? 
Answer : Significant Action : Set p(p= "No")=0 
Answer : Not sig. Action : Set p (p=" Yes " ) =0 
Answer: Manual Action : Set p. 

Answer: Don't know Action : Set p (p« "No" ) =p (p=« Yes " ) 
Stage 2: Set the following links: 



FROM: 


j = 


"2 " 


TO: 


t 2 


WEIGHT: 


1 




FROM: 


j = 




TO: 


t 2 


WEIGHT: 


0 


.8 


FROM: 


j = 


"4-10" 


TO: 


t 2 


WEIGHT: 


0 


.5 


FROM : 


3 = 


"4-10" 


TO: 


t a 


WEIGHT: 


0 


.5 


FROM: 


3 = 


"11-20" 


TO: 


tj 


WEIGHT: 


0 


.8 


FROM: 


j = 


"11-20" 


TO: 


t 3 


WEIGHT: 


0 


.5 


FROM: 


j = 


"20+" 


TO: 


ti 


WEIGHT: 


1 




FROM: 


j = 


"20+" 


TO: 


t 3 


WEIGHT: 


0 


.8 


FROM: 


k= 


"Yes" 


TO 


: t 2 


WEIGHT: 


0 


.6 


FROM : 


k= 


"Yes" 


TO 


: t 4 


WEIGHT: 


1 




FROM : 


k= 


"No" 


TO 


: t! 


WEIGHT: 


0 


.7 
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WEIGHT: 0.4 



TO: t 1 



FROM : n=" Private" 
FROM; n=" Common" TO: t 2 

5 FROM: n= "Correlated" TO: t 



WEIGHT: 0.7 
WEIGHT: 0.8 
WEIGHT: 0.6 



FROM: o= "Yes" 
FROM: o="Yes" 
FROM: o= rr No" 
FROM: o="No" 



TO: t 2 

TO: t 4 

TO: t 2 

TO: t 3 



WEIGHT: 0,6 

WEIGHT: 1 

WEIGHT: 0.7 

WEIGHT: 0.4 



FROM: p=r»Yes" 
FROM: p="No" 
FROM: p="No" 



(3) Updating rules 

Type I : 
See later 



TO: t 2 
TO: t, 



WEIGHT: 0.8 
WEIGHT: 0.1 



TO: t 3 WEIGHT: 0.6 



Type II: 
See later 
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Updating 

Two methods which may be employed for updating the p 
values (i.e. type 1 updating) in the examples above , will 
5 now be explained. 

Note that the user referred to in the following two 
examples is not one of the negotiating parties, but 
rather the protocol itself (i.e. the system which 
mediates between the negotiating parties) . 

10 

Method I: Forward on-line updating 

For each proposition in the set {On-line} the system 
invites the user to input values on-line. (In addition, 
the user can at any stage, update the value associated 
15 with any of the propositions) . 

The following procedures is applied when a 
proposition, say j, is being updated On-line: 

Denote by j lf j 2 , . . ,j N the possible values of 
proposition j (for example: for the proposition "number 
20 of bidders" in example 3 there are five possible values: 
"2", "3", "4-10", "11-20", and "20+"). 

The system asks the user whether the old values 
should be overwritten or updated (note that at the on- 
line stage all propositions have been assigned initial 
25 values) : 

If overwritten: 
(l)User enters new values v(j a ) , v(j 2 ) , . . .v(j N ) , which 
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satisfy v(ji)>0 for all i=l, , . .N. At least one of these 
values is strictly positive and 



I v(y.) < i. 



5 (2)For all vCjJ^O, set: 



( \ -old 



p°"U*j>) 



kel f ^Natidv(Jfc)=0 



10 If updated: 

(l)User enters updating weights w(j x ), w(j 2 ), ... w(j H ). 
i At least one of which is different from zero. 
| (2)Set p old (j=jJ=p old (j=jJ+w(jJfor j=l N 

^ 15 (3) Set 

: , . P old U-P) 

1 PU = JO = v otf/ • ~7 

2, p 0 = 

Method II: Backward On-line updating. 

20 The following procedures is applied when the probability 
of one of more of the states in T is being updated On- 
line : 



Denote by t a/ t 2 , ... t N the possible states in T. 

25 

STAGE I 

As in the forward updating procedures, the system asks 
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the user whether the old values should be overwritten or 
updated: 

(1) User enters new values vCt^ , v(t 2 ) , ... v{t N ) , which 
must satisfy vftJ^O for all i+l,...,N, At least one of 
these values is strictly positive, and 

I v(f.) < 1. 

j»l,.,AT 

(2) For all v(ti)=0, set: 



10 



JfceI,..JVWv(7*)=0 



15 



If updated: 

(1) User enters updating weights wltj), w(t 2 ) , 
At least one of which is different from zero, 

(2) Set p oid (tJ=p(t i )+W{t i ) for i=l , N 

(3) Set 



Z p<**(tj) 



* W(t N ) 



20 



25 



STAGE 2 

For each state t ± such that p(tj had changed, find all 
links which lead to it (for example, for t x in example 1, 
there are 4 links which lead to it: from m= 11 YAll" / from 
m="NAll n / from i="l-l" and from l="<l/3"). 



Denote these links by L xl/ L i2 , ... L xN and by P(L 13 ) the 
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specific value that this link leads from, and by (V(L i3 ) 
the specific value of that proposition which triggers the 
link (for example, for the link from m="NAll" to Tl, 
P(L a3 ) is m, and V(L lf4 ) is "NAll"). Finally, denote by 
S(L i:t ) the weight associated with the link L in . 



(1) Set: 



1 (2) Normalise the probabilities: 

110 For each proposition for which the above probability of 
at least one of the possible outcomes had changed as a 

% result of the above calculations, the following 
normalising procedure will be carried out: 

15 Denote the proposition by j, and the possible outcomes as 

n i / J2 - • - 3 n • 

Set 



20 



■> P u=ri 

PU - JO - v aid/ - ^ * 

If all links lead to event which have zero probabilities 
the above calculations will not work (division by 
zero) .This implies that an event with zero probability 
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now becomes likely (or even already occurred) . In this 
case, the set S T and the probabilities P are re-computed, 
by informing the user and re-doing the appropriate off- 
line algorithm. 

Example 4 

Example 4 is a detailed example of how a system such 
as that shown in Fig. 1 within the scope of the invention 
may use the communication protocol to regulate 
negotiations between self-interested agents; to diagnose 
and fix inefficiencies. 

First, consider the example of an auction protocol. 
Here self-interested agents, representing different 
individuals and/or organisations, bid according to the 
rule specified by the protocol, in order to get the 
objects or services that are being auctioned. 

Using the sets S, T, and the weights P (which are 
explained in detail in examples 1-3), the protocol is 
initiated with the information that there are no big 
players present, and that the game is not repeated. For 
example, the following values are entered by the user 
(protocol) : 
p(i=" selling") =1 
p (i="4~l0 n ) =1 
p (k= ,! No") =1 
p (l="object") =1 
p(m=" single value") =1 
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p(n=private value") =1 
p (o="No") =1 
p (p="No") =1 

This, with the rest of the information induces a 
distribution over the states in T. In particular, the 
probabilities of states t x and t 3 will be close (or even 
equal) to l, while the probabilities of states t 2 and t A 
will be close to zero. The protocol then chooses, based 
on available information, to use an English auction 
protocol . 

An English auction protocol incrementally raises the 
asking price for the object/service. At each price 
agents can drop out from bidding (i.e. the current asking 
price is deemed too high for their users) . When all 
agents but one dropped out, the remaining agent wins the 
object. An English auction is efficient and maximises 
the expected revenues for the seller when there are no 
signalling and price rigging by bidders, for example when 
there are no big players who interact repeatedly. 

Suppose however, that there is signalling between 
big players, for example, the agent of organisation B 
drops out immediately when the agent representing 
organisation A starts bidding for an object, and that in 
the next round, A drops out when B starts bidding. This 
type of behaviour is possible in an English auction 
because agents can observe each other's bidding. This 
inefficiency will be recognised by the invention, because 
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the observed outcomes (for example the revenues generated 
by the auction protocol) correspond to states in T which 
have zero (or close to zero) weighting. Specifically, the 
auction protocol, which follows bidding histories and 
5 outcomes, transmits the following information, based on 
this observation, to the reasoning system: v= (tl) =0 . 05, 
v (t 2 ) =0 . 4 v(t 3 )=0 v (t 4 ) =0 . 5 . Using the backward on-line 
updating (as described above) , the reasoning system 
detects a mismatch (technically, this happens when the 
■q 10 formula for updating involves dividing by zero) . The 
i.i reasoning system then transmits to the communication 

^ protocol the information of this mismatch and the likely 

reason (i.e. "Observed behaviour is not consistent with 
current S T! , probably because there are big players 
\ 15 present, or the bidders signal through repeated 
interactions) . 

The protocol can respond to this information by 
changing its bidding protocol from an English auction to, 
for example, a sealed bid auction where agents submit 
20 secretly bids representing the price their users are 
willing to pay for the auctioned object or service. 
Signalling between agents is much more difficult in a 
sealed bid auction, and this change is therefore likely 
to restore efficiency, and increase expected revenues for 
25 sellers . 

Another way in which the invention can be used by 
the communication protocol to regulate negotiations 
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between self-interested agents will now be given in the 
context of direct one-to-one negotiations. Suppose that 
a multi-agent system (MAS) uses an alternating-offers 
protocol for direct negotiations between agents. That 
5 is, each agent in its turn either accepts the current 
offer or rejects it and makes a counter offer. The 
process of offers and counter offers continues until one 
of the agents accepts an offer, which is then 
implemented. Suppose further that the MAS uses this 
,q 10 protocol for co-ordination of the usage of a limited 
h] resource between different individuals. For example, 

y. individuals within an organisation which negotiate the 

Y!_ usage of the meeting room, or access to busy Internet 

;, r connection, and so on. 

; l 15 Generally speaking, the alternating-offers protocol 

\' b is efficient if agreements are reached quickly, i.e. 

h within a small number of rounds of offers and counter- 
offers. If agents tend to not make concession, the 
protocol can be very inefficient, because the network 
20 resources used by agents to carry out these fruitless 

negotiations are effectively wasted. The invention can 
be used to detect such inefficiencies. The invention, as 
used for direct negotiations (as explained above) , 
expects agreement to be reached relatively quickly 
25 because agents expect to negotiate according to their 
bargaining power (as determined by the underlying 
strategic considerations like outside offers, and so on) . 
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If the invention detects that this is not the case - the 
observed behaviour differs considerably from that induced 
by the distribution over the set of outcomes T - then 
this information can be transmitted to the protocol which 
governs agents 1 communications . The protocol can change 
the alternating- of f ers protocol to, for example, a more 
centralised protocol where all agents submit their 
request for using the limited resource, and the protocol 
then returns a resource allocation scheme based on some 
given algorithm (for example, a "first come first served" 
algorithm) . 

Example 5 

Example 5 is an explanatory example of how a system 
such as that shown in Fig. 6 within the scope of the 
second aspect of the invention is used by a single 
organisation to control its own bidding strategy. 

The general definitions described in relation to 
examples 1 to 3 are still valid for this use of the 
invention, with the difference that the set T now 
represent the set of available bidding strategies . Once 
P and S are set, the values of states in T 1 can be 
computed (see stage (3) above) . These weights now 
represent not the likelihood of these behaviours in 
equilibrium (as in the above examples) , but rather, the 
likelihood of these strategies being optimal for the 
organisation (in the sense that they lead to maximising 
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Fig. 6 illustrates schematically an example j of how 
the invention fits with the other purchasing support 
software used by the organisation. The system comprises 
5 three portions, a section 11 made up of IT systems which 
are well known in the field of automatic trading agents, 
an interface and integration section 13 of additional IT 
components, and a reasoning system 15 which is an 
apparatus according to the invention. 
^10 The section 11 in this figure comprises an 

enterprise resources planning and supply chain ("ERP"), a 
;~ database, and an internet procurement device. 
;^ Section 13 is a user interface, which also 

coordinates the interaction of the reasoning system 15 
-;:'.15 with the known agent systems 11. 

Upon a request 17 being submitted to the section 13 
il (e.g. "buy 100 tonnes of sugar"), the request is 

processed and integrated with existing software 11 (for 
example, although in the figure the user request 17 is 
20 shown arriving from outside, e.g. from a human user, the 
request 17 might alternatively be generated by the ERP, 

The reasoning section 15 reasons as described below 
and above, and makes a decision of who to buy from, how 
much to buy from each seller, and what 
25 bidding/negotiating strategy is most likely to work. 

For example, as shown schematically in Fig. 6, the 
reasoning system may decide to bid in a certain auction, 
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to buy at a fixed price from a certain seller, to open up 
direct negotiation with a certain seller, or to transmit 
to a certain seller a request for that seller to name his 
price . 

5 As a specific instance, consider a corporate buyer 

requiring a large number of units of some manufacturing 
materials (say 100 tones of cement, or 500 tones of 
sugar, and so on) . The corporate can buy from any of 
three approved vendors, and/or from an on-line auction 
10 site specialising in these materials. A strategy 
H therefore consists of how much to bid in the auction and 

;~: how to negotiate with each of the approved vendors 

(assuming at least some features of the deal, like prices 
or delivery date, are negotiable. This assumption is 
1^15 realistic in most corporate purchasing scenarios) . For 
h- example, one strategy would be to bid aggressively in the 
auction and to act "tough" in all three direct 
negotiations (for example, insisting on getting a volume 
discount) . Of course this strategy will be successful 
20 only if the corporate is likely to win the auction 
(because its bid is higher than all the other 
participants) . Otherwise it might be better to be more 
flexible while negotiating with at least one of the 
approved vendors, in case the corporate will end up 
25 buying there (for example because it did not win the 
auction, or because it only managed to secure a small 
number of units from the auction, which is not sufficient 
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for its needs) . 

In this example, the set S will contain information 
on (1) whether the interactions are repeated or not (2) 
does vendor A respond to negotiations (and similarly for 
vendors B and C) (3) the type of auction mechanism used 
(4) the relative market power of the organisation. And 
so on* Once S and P are set, the values of states T can 
be computed. The distribution over these states 
correspond to the estimated likelihood of the various 
negotiation strategies to be optimal for the 
organisation, given the available information. On-line, 
once negotiations starts, these states can be updates 
backwards and forwards, as explained in relation to 
examples 1 to 3 . At any stage, the organisation can use 
the invention to select its bidding and negotiating 
strategy . 

Fig. 7 shows how an embodiment of the invention can 
be used by a single corporate buyer. 
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Claims 

1* A method of regulating negotiation between two or more 
negotiating parties which communicate using an electronic 
5 communication network, the method employing a set of 
negotiating propositions characterizing a negotiating 
environment, the propositions including one or more 
hypotheses, and the method having the steps of: 

for each of said one or more hypotheses deriving a 
10 respective numerical confidence value, the or each 

confidence value representing confidence in the truth of 
the respective hypothesis; and 

regulating the negotiation between said negotiating 
parties using said electronic communication network, 
15 based on said one or more confidence values, 

2 . A method according to claim 1 in which the 
negotiating parties negotiate according to a set of 
rules, and said regulation includes varying the set of 
rules based on said one or more confidence values. 
20 3 . A method according to claim 2 in which the set of 

rules are varied upon said one or more confidence values 
indicating a high likelihood of the negotiation reaching 
a predetermined disadvantageous condition. 
4 . A method of negotiation with one or more other 
25 negotiating parties by communication using an electronic 
communication network, the method employing a set of 
negotiating propositions characterizing a negotiating 
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environment, the propositions including one or more 
hypotheses , and the method having the steps of : 

for each of said one or more hypotheses deriving a 
respective numerical confidence value, the or each 
confidence value representing confidence in the truth of 
the respective hypothesis; and 

negotiating based on said one or more confidence 
values . 

5. A method according to claim 4 in which said step of 
negotiating based on said one or more confidence values 
comprises using said one or more confidence values to 
select one of a number of predetermined negotiating 
options . 

6. A method according to claim 4 or claim 5 in which 
said step of negotiating based on said one or more 
confidence values comprises using said one or more 
confidence values to determine a numerical proposition 
which characterises an offer. 

7. A method according to any preceding claim which 
includes at least once performing the additional step of 
re-evaluating said one or more confidence values based on 
observed characteristics of said negotiation. 

8. A method according to any preceding claim comprising 
a step, before said step of deriving confidence values, 
of deriving at least some of the set of negotiating 
propositions based on characteristics of the negotiating 
environment , 
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9 . A method according to claim 8 in which the method 
includes a re-evaluation step of altering the one or more 
hypotheses, followed by a re-derivation of confidence 
values for the new set of hypotheses. 

10 • A method according to claim 9 in which the re- 
evaluation step is performed upon detecting an 
inconsistency between the confidence values and new 
information, the re-evaluation eliminating the 
inconsistency with the new information. 

11. A method according to claim 10 in which said step of 
altering the one or more hypotheses includes evaluating 
the importance of new information, and altering the 
hypotheses in the case that the information is evaluated 
to be important . 

12. A method according to claim 11 in which the one or 
more hypotheses concern one or more of (i) 
characteristics of the bargaining power of one or more 
further negotiating parties, (ii) characteristics of 
agents involved in the negotiation (e.g. based on past 
experience) , or (iii) are based on types of goods or 
services which are a subject of the negotiation. 

13 . A method according to any preceding claim further 
including a step of ^ normalising the confidence values. 
14. A method according to any preceding claim in which, 
in addition to the one or more hypotheses, the 
negotiating propositions further include additional 
propositions which characterize the negotiation process, 
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the additional propositions being in terms of numerical 
characterization variables, and the method including a 
step of setting the characterization variables. 

15. A method of monitoring a negotiation using an 

5 electronic communication network, in which a plurality of 
negotiating parties negotiate regulated by a set of 
negotiating propositions including one or more 
hypotheses, the method including identifying, by 
comparing the actual negotiation to the negotiating 
10 propositions, a characteristic of the negotiation. 

16. A method according to claim 15 in which the 
characteristic is a liability of the negotiation to 

=H inefficiency in time and/or revenue generated. 

17 . A method according to claim 15 or claim 16 including 
15 the further step of transmitted the characteristic to one 

or more of the parties, to cause that party to modify its 
11 behaviour. 

18 . A method according to any preceding claim in which 
the parties are self-interested agents interacting using 

20 an electronic communication network. 

19. A method according to claim 18 in which the agents 
are automatic agents. 

20. A method of linking available data and expected 
behaviour of self-interested agents interacting using an 

25 electronic communication network, the method employing a 
set of negotiating propositions characterizing a 
negotiating environment, the propositions including one 



SUBSTITUTE SHEET (RULE 26) 



WO 00/25242 PCT/GB99/03528 

60 

or more hypotheses, and the method having the steps of: 
for each of said one or more hypotheses deriving a 
respective numerical confidence value, the or each 
confidence value representing confidence in the truth of 
5 the respective hypothesis; and 

linking available data and expected behaviour of 
said agents based on said one or more confidence values* 
21. An apparatus for regulating negotiation between two 
or more negotiating parties which communicate using an 
1(3\ electronic communication network, the apparatus having: 
!\' means for storing a set of negotiating propositions 

i- : characterizing a negotiating environment, the 
^ n propositions including one or more hypotheses; 
; means for deriving for each of said one or more 

15;': hypotheses a respective numerical confidence value, the 
].-. or each confidence value representing confidence in the 
Li truth of the respective hypothesis; and 

means for regulating the negotiation between said 
negotiating parties using said electronic communication 
20 network, based on said one or more confidence values. 

22 . An apparatus for negotiating with one or more other 
negotiating parties by communication using an electronic 
communication network, the apparatus having: 

means for storing a set of negotiating propositions 
25 characterizing a negotiating environment, the 
propositions including one or more hypotheses: 

means for deriving for each of said one or more 
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hypotheses a respective numerical confidence value, the 
or each confidence value representing confidence in the 
truth of the respective hypothesis; and 

means for electronically negotiating based on said 
one or more confidence values. 

23. An apparatus according to claim 21 or claim 22 which 
is electronically connected to the world wide web. 

24. A computer program product readable by a computer 
device for causing the computer device to perform a 
method according to any of claims 1 to 20. 
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